TRANSFER OF IDEALS AND QUANTIZATION OF SMALL 
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Abstract. We introduce and study a transfer map between ideals of the uni- 
,.0 ' versal enveloping algebras of two members of a reductive dual pair of Lie 

algebras. Its definition is motivated by the approach to the real Howe duality 
MH i through the theory of Capelli identities. We prove that this map provides a 

lower bound on the annihilators of theta lifts of representations with a fixed 
annihilator ideal. We also show that in the algebraic stable range, transfer re- 
spects the class of quantizations of nilpotent orbit closures. As an application, 
we explicitly describe quantizations of small nilpotent orbits of general linear 
■ and orthogonal Lie algebras and give presentations of certain rings of algebraic 

m^J ' differential operators. We consider two algebraic versions of Howe duality and 

reformulate our results in terms of noncommutative Capelli identities. 

a- 

1. Introduction and the main results 

There is a well known relation, going back to Alfredo Capelli, between the centers 
^ ' of the universal enveloping algebras of two Lie algebras forming a reductive dual 

pair in the sense of Howe, [H [9l [26]. From the modern viewpoint, it arises by 
restricting the oscillator representation of the real symplectic group to the members 
of the dual pair and manifests itself via the so-called Capelli identities, [TT1 [T2l [T8] . 
The case originally considered by Capelli in [3] is now known as the (GL„, GL m ) 
duality, |10j . Capelli identities have important applications to the study of the theta 
correspondence: they determine the correspondence of the infinitesimal characters 
of the representations matched under the Howe duality, cf [7J [35] . The goal of the 
present paper is to extend this formalism from central elements to more general ad- 
invariant subspaces and ideals of universal enveloping algebras. We define a certain 
' transfer map between two-sided ideals of the universal enveloping algebras of the 

two members of a reductive dual pair, establish its basic properties, and compute it 
in a special case, for the annihilator of a one-dimensional representation of g', i.e. a 
codimension one ideal of U(q'). If the reductive dual pair is in the stable range with 
q' the smaller member, this amounts to a noncommutative analogue of the Kraft- 
Procesi lifting of the zero orbit, [M], and yields an ideal / of U(q) quantizing the 
closure of a small nilpotent orbit in a classical Lie algebra g. We explicitly describe 
an ad(g)-invariant subspace generating / when q is a general linear or orthogonal 
Lie algebra. 

Let K be a field of characteristic zero, W a symplectic vector space over K, sp(W) 
the symplectic Lie algebra of W and (0,9') an irreducible reductive dual pair of 
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Lie algebras. By definition, this means that g and g' are Lie subalgebras of sp(W / ) 
that are full mutual centralizers, W is completely reducible as a g-module and a 
g'-module, and the action of g © g' on W is symplectically irreducible. Reductive 
dual pairs were classified by Howe, see [7]. If K is algebraically closed then either 
(1) both g and g' are general linear Lie algebras (type II), or (2) one of them is a 
symplectic and the other is an orthogonal Lie algebra (type I) . The embedding of the 
pair (g,g') into sp(W^) is determined uniquely modulo symplectic automorphisms 
of W. (Later on we will fix a particular realization of the dual pair.) Consider 
the Weyl algebra of W, denoted W. Its definition and properties are recalled in 
Section 12.11 but the salient point is that the universal enveloping algebras of g 
and g' have canonical homomorphisms into W, and it follows from Howe's Double 
Commutant Theorem, [H], that the images of these homomorphisms are the full 
mutual centralizers in the even Weyl subalgebra. 

Definition 1.1. Let L : U(g') — > W and R : U(g) — > W be the canonical homo- 
morphisms into the Weyl algebra. For any subspace I' of U(g'), its transfer 0(1') 
is defined to be the subspace of U(g) which is the pull-back via R of the right ideal 
generated by the image of I 1 in W: 

(1.2) 0(1') =R- 1 (L(I')-W). 

The preimage should be understood in the following way: we consider those 
elements of L(I') ■ W which belong to R(U(g)), or equivalently (by the Double 
Commutant Theorem), which are G'-invariant, and lift them to U(g). The lifting 
is well-defined on the level of subspaces and the resulting subspace of U (g) contains 
keri?. It is easy to see that I — 0(1') is always a right ideal in U(g) and that if I' 
is a two-sided ideal of U(g') then / is a two-sided ideal of U(g). The next theorem 
motivates this definition: it shows that the transfer map is compatible with the 
Howe duality correspondence for real Lie groups. 

Theorem 1.3. Let (Gq,G' ) be an irreducible reductive dual pair of real Lie groups 
with the complexified Lie algebras g and g' . Suppose that p and p' are irreducible 
admissible representations of the metaplectic covers of Go and G' that correspond 
to each other under the real Howe duality correspondence, 9 . Denote by I and I' 
the annihilators of p and p' in the universal enveloping algebras U(g) and U(g'). 
Then 6(1') C I. 

Generalizing Howe and Umeda's treatment of the classical Capelli identities, 
in Section [5] we interpret the ideal 6(1') as a system of noncommutative Capelli 
identities. Note that 6(1') provides only a lower bound for the annihilators of 
the representations of the metaplectic cover of Go that are matched under the 
Howe duality correspondence with representations of the metaplectic cover of G' 
with a fixed primitive annihilator V . It is a subtle problem to formulate sufficient 
conditions for the equality to hold. This question is further discussed at the end of 
the paper. 

The transfer in general is rather complicated. However, we show that ideals 
of special type, quantizations of nilpotent orbit closures, behave well under the 
transfer. 

Definition 1.4. An ideal / of the universal enveloping algebra U(g) is a quanti- 
zation of the orbit closure O if the associated graded ideal gr I is the prime ideal 
defining O. 
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The property of being a quantization of an orbit closure is very strong and it 
implies that the ideal is completely prime and primitive. When g is general or 
special linear Lie algebra, the converse statement had been conjectured by Dixmier 
and was proved by Moeglin, [17]; it fails for other types. 

Theorem 1.5. Let (g,g') be an irreducible reductive dual pair of Lie algebras in 
the stable range with the smaller member g' . Suppose that I' is a completely prime, 
primitive ideal of U(g') quantizing an orbit closure O . Then its transfer O(L') 
is a completely prime, primitive ideal of U (g) quantizing an orbit closure O, the 
Kraft-Procesi lifting of O . 

We give a short direct proof of this theorem based on the flatness of the moment 
map I in the stable range. 

The preceding theory is made more explicit in the case of a one-dimensional 
representation of g' and its annihilator This ideal has codimension one in U(g'), 
quantizes the zero orbit, and has an obvious system of generators. We explicitly 
compute an ad-invariant system of generators of its transfer / = 6(1') C U(g). 
By Theorem 11.51 the ideal / obtained in this way is a quantization of the prime 
ideal defining an orbit whose Young diagram has exactly two columns (we call such 
orbits small). It is convenient to state our description of the generators of I in 
terms of "noncommutative linear algebra" , using a certain matrix with elements in 
U(q) (see Section @] for the precise formulations, including the notation). 

In the general linear case, g = g [„ , let us denote by E the n x n matrix over U(gl n ) 
whose ijth entry is E^-, the standard generator of g[ n given by the (i,j) matrix unit. 
In Theorem 14.61 we show that the ideal / is generated by the trace of E shifted by 
a certain constant, the matrix entries of an explicitly given quadratic polynomial 
in E, and quantum minors of E introduced in [23j . cfDcfinition 14.31 The main 
result in the symplectic-orthogonal case, Theorem 14. 131 has similar form, with the 
quantum pfafftans of [121118] replacing the quantum minors, c f Definition 14 . 1 ll Note 
that, in contrast with the case of minimal nilpotent orbits considered by Kostant, 
for a more general small nilpotent orbit there are relations of degree greater than 
two arising from quantum minors and pfafnans. 

It follows from the work of Borho-Brylinski, |2j, and Levasseur-Stafford, [T5] . 
that the ring of algebraic differential operators on the (projective, nonsingular) 
Grassmann variety or the (affine, singular) rank variety may be identified with the 
quotient of U(g) by the ideal of this type. Therefore, we obtain presentations of 
these noncommutative rings of differential operators by generators and relations. 

2. Preliminaries 

The goal of this section is to set up the terminology and review the basic prop- 
erties of Weyl algebras, reductive dual pairs, and nilpotent orbits. We present a 
formulation of the theory of spherical harmonics in the form needed to compute 
transfers of ideals. Sections 12.11 and 12.31 follow the approach of Howe's Schur Lec- 
tures [TO], where many details may be found. 

2.1. Weyl algebra. Let W be a symplectic vector space. The Weyl algebra W is 
a filtered algebra generated by the vector space W in degree 1, modulo the relations 
u>iu>2 — W2W1 — (wi, u)2)- Its associated graded algebra is the symmetric algebra of 
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W, the group Sp(W) acts on W by filtered algebra automorphisms, and W decom- 
poses into a direct sum over non-negative integers n of finite-dimensional Sp{W)- 
modules W™ — 5™(W). The components of this decomposition are irreducible and 
mutually non-isomorphic modules, therefore, there is a canonical Sp(VF)-invariant 
linear symbol map between W and S(W). On the elements of degree 2 in S(W), 
the (inverse) symbol map is given by the formula: 

s~ 1 (wiw 2 ) = ~(wiw 2 + W 2 Wl). 

Furthermore, [W 2 , W n ] C W" and the adjoint action of W 2 on W coincides with the 
infinitesimal action of Sp(W), the symplectic Lie algebra of W. The direct sum A of 
all even components W 2k , k > 0, is a subalgebra of W called the even Weyl algebra. 
It is generated by W 2 , the lowest positive degree component, and hence A is a 
quotient of the universal enveloping algebra U (sp(W)). Howe's Double Commutant 
Theorem states that, given a reductive dual pair of Lie algebras, the subalgebra 
R(U(q)) of the Weyl algebra coincides with the subalgebra of G'-invariants in W, 
which also coincides with the space of ad(g')-invariants in the even Weyl algebra, 
zewith the commutant of g' or L(U(q')) in A. 

2.2. Moment maps and the Kraft Procesi lifting. The Weyl algebra W is a 
noncommutative filtered algebra, and the maps L : U(g') — > W and R : U(g) — > W 
become filtered maps if the elements from g' C U(q') and g C U(g) are assigned 
degree two. Taking the associated graded maps, we get a pair of commutative 
algebra homomorphisms, gri : S(g') — > S(W) and gri? : 5(g) — > S'(W), and we 
denote the corresponding morphisms of algebraic varieties by I : W* — * g'* and 
r : PF* — > g* and refer to them as the moment maps. 

A reductive dual pair (g, g') of Lie algebras canonically determines a reductive 
dual pair (G, G') of algebraic groups over K as follows: G is the pointwise stabilizer 
of g' in Sp(W) and G' is the pointwise stabilizer of g in Sp{W). If g is a general 
linear Lie algebra then G is the corresponding general linear group, and if g is the 
Lie algebra of infinitesimal symmetries of a bilinear or a sesquilinear form then G is 
the full isometry group of the form (G may be disconnected), and similarly for G'. 
We call G and G' the classical groups of g and g', they form a reductive dual pair 
in Sp{W). The maps / and r are equivariant with respect to the natural actions 
of G and G' on g*,g'*, and W* . Moreover, the First Fundamental Theorem of 
Classical Invariant Theory for vector representations states that I (respectively, r) 
is the affine factorization map for the action of the group G (respectively, G') on 
W in the sense of invariant theory. 

Nilpotent orbits of a classical Lie group G over an algebraically closed field 
of characteristic zero with TV-dimensional defining module arc parametrized by 
certain integer partitions of N whose parts are the sizes of the Jordan blocks of 
any nilpotent matrix in the orbit. These partitions must satisfy additional parity 
conditions in the symplectic and orthogonal cases, [4]. We call an orbit O small 
if the largest part of the corresponding partition is equal to two, equivalently, if 
its Young diagram consists of two columns. Small nilpotent orbits are classified by 
their rank, the rank of any matrix in the orbit. The rank is an integer between 1 
and N/2 equal to the length of the second column of the Young diagram, and must 
be even if g = On is an orthogonal Lie algebra. (In the case G = On , N = 4k, the 
small nilpotent G-orbit of rank 2k is very even, and breaks up into two nilpotent 
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orbits for the special orthogonal group SOn-) For example, the minimal orbit is 
small. Small orbits are spherical and form a complete chain in the poset of nilpotent 
orbits ordered by the inclusions of their closures. 

Definition 2.1. Let O' be a nilpotent coadjoint orbit in g'* with Zariski closure 
O . The Kraft -Procesi lifting associates with it the G-invariant affine subvariety 
= r{l- 1 (p')) of g*. 

The variety O arising from the Kraft-Procesi lifting is the closure of a nilpotent 
coadjoint orbit O C g*. Moreover, if (g, g') is in the stable range with g' the smaller 
member then the Young diagram of O is obtained from the Young diagram of O' 
by adding an extra first column of the appropriate length. In particular, if O' is the 
zero orbit then O is small. For (g, g') in the stable range, these facts were proved by 
Kraft and Procesi, and this is precisely the case we are going to use. More general 
results appeared in [5]. 

2.3. Reductive dual pairs and the theory of harmonics. Let (g,g') be a 
reductive dual pair of Lie algebras. We say that (g,g') is in the stable range, with 
g' the smaller member, if the dimension of the defining module of g is at least twice 
the dimension of the defining module of g'. Thus (fll n ,fllfe) is in the stable range 
with gl k the smaller member if and only if n > 2k. More generally, we consider 
reductive dual pairs with g 1 the smaller member, defined through comparison of 
the dimensions of the defining modules. 

The double of the symplectic vector space W is the vector space W d = W © 
W* , with a natural symplectic form making this direct sum decomposition into a 
lagrangian polarization. We denote by g d the centralizer of g' in the symplectic 
Lie algebra of W d and call it the double of the Lie algebra g. Then (g d ,g r ) is a 
reductive dual pair in sp(W d ). Let g be the centralizer of g in the general 

linear algebra of W. The Weyl algebra W d of the double W d acts on S(W) by 
polynomial coefficient differential operators in the standard way. The Lie algebra g d 
has the following decomposition arising from the polarization of W d and the induced 
decomposition of the second component of W d as S 2 {W) © (W <g> W*) © S 2 {W*)\ 

(2.2) d = fl©0©£l*, 

where the three summands correspond to (2, 0), (1, 1), and (0, 2) components of g d 
in the terminology of [S]. In the setting of an irreducible reductive dual pair (g,g') 
over an algebraically closed field, we have the following possibilities: (I) g = gl n is 
a general linear algebra and g — gl n x gl n with g embedded diagonally; (2) g = sp 2n 
is a symplectic Lie algebra and g — gl 2n is the corresponding general linear algebra; 
(3) g = On is an orthogonal Lie algebra and g = gl N is the corresponding general 
linear Lie algebra. 

The space H of G'-harmonics is the subspace of S(W) annihilated by the action 
of the G'-invariant constant coefficient differential operators. Equivalently, it is 
the kernel for the action of the (0, 2)-component of g d in the decomposition (|2.2[) . 
The space of harmonics is G'-invariant and has a direct sum decomposition into 
isotypic components corresponding to finite-dimensional simple G'-modules. It was 
discovered by Gelbart and generalized by Howe that harmonics have very special 
structure: the space H T of G'-harmonics of type r is an irreducible G' x G-module 
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of type r (g) a and generates the r-isotypic component of S(W). Here a is an iso- 
morphism class of simple finite-dimensional G-modules and is uniquely determined 
by r. The correspondence between a and r is explicitly described in [lOj . 

Denote the associated graded algebras of W and U(g') by A and B. Since g' 
is the smaller member of the dual pair, the map grL is an injection, and we will 
pretend that it's just the identity map, so that B is a subalgebra of A and U(g') 
is a subalgebra of W. The next theorem is a restatement of the decomposition 
of A = S(W) into invariants and harmonics arising from the reductive dual pair 
(g d ,g') msp{W d ). 

Theorem 2.3. Suppose that r is an irreducible g' -module, t* its contragredient, 
and V T is an ad(g') -invariant subspace of B — S(g') isomorphic to r. Let a be 
the g d -module corresponding to t* in the space of harmonics. Then (V T A) G is 
generated as a S{g)-module by the subspace U„, the result of the Ad{G') -invariant 
multiplication pairing between V T and Ji r * , and XJ a is an irreducible G -module of 
type a. 

3. Quantizations of nilpotent orbit closures 

The main goal of this section is to establish Theorem 11.51 Our proof is based 
on a pair of remarkable properties of the moment map I : W* — » g'* in the stable 
range. 

Proposition 3.1. Let (g,g f ) be an irreducible reductive dual pair in stable range 
with g' the smaller member. Then the moment map I : W* — > g 1 * is flat and its 
geometric fibers are irreducible. Ln fact, S(W) is a free S{g')-module. 

Proof. By the method of associated cones and the dimensional criterion of flatness, 
it is enough to verify that the zero fiber ^ _1 (0) is reduced and irreducible, of di- 
mension dimVl^* — dimg'*. By [13j[T4], the zero fiber is an irreducible complete 
intersection. The last assertion follows because S(W) is a graded algebra and S(g') 
is its graded subalgebra. □ 

It is a general fact from commutative algebra that in the situation of Proposi- 
tion [3J] the scheme-theoretic preimage of an irreducible subschcmc of the base is 
reduced and irreducible. 

Proposition 3.2. Let A be an affine algebra over a field K, B its affine K- 
subalgebra. Assume that A is flat as a B-module and for any maximal ideal m 
of B, the ideal mA C A is prime. Then for any prime ideal P of B, the ideal PA 
of A is prime. 

Proof. In an affine algebra, a prime ideal is the intersection of the maximal ideals 
that contain it. The flatness of A over B implies that intersections are compatible 
with the "base change" from ideals of B to ideals of A, S i— ► SA. Therefore, PA 
is the intersection of the ideals of the form mA for various maximal m D P, which 
are prime by assumption. Suppose that fg G PA, then for every such m, either / 
or g is contained in mA. Since these are Zariski closed conditions on m and V(P) 
is irreducible, either / or g is contained in mA for all m containing P. It follows 
that either / or g is contained in PA, establishing its primeness. □ 

Proof of Theorem \1.5l We show that / has the desired property using Propositions 
l3.1l and [3T^l and the standard filtered-graded techniques. As in Section denote 
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grW and grJ7(g') by A and B and view B as a subalgebra of A Then U(q') is a 
subalgebra of W. Moreover, by Proposition 13. 1[ A is a flat i?- module. Here is the 
crucial step: the flatness of A over B implies by [I], Chapter 2, Theorem 8.6 that 

(3.3) gr(/'W) = (grJ')A. 

By assumption, the ideal P = grl' is prime. Proposition 13.21 then shows that the 
ideal PA is prime, and the corresponding irreducible subvariety of W* is l~ l (0 ). 
Pulling back I'W via R and recalling that R(U(q)) coincides that with the G'- 
invariants of W, we see that gr 9(1') = (gr R)~ 1 (PA) and that the ideal in the right 
hand side defines the subvariety r(7 -1 (0 )) = O. Thus 9(1') is a quantization of O, 
as we claimed. □ 

Using flatness to prove good properties of the associated graded construction is 
a staple of noncommutative algebra and goes back at least to Bjork's book [Tj. The 
papers [SJ [57] used a more sophisticated approach via the Koszul complex, which 
resulted in the analogue of Theorem 11.51 in a related context of quiver represen- 
tations, but only for ideals I 1 of special form, the annihilators of one-dimensional 
representations. By providing a more direct proof, we are able to treat the case of 
arbitrary I'. 

Remark 3.4. Our argument can be adapted to analysis of the effect of transfer 
on the associated cycles of ideals. We hope to return to this question in a future 
publication. 

4. Transfer of codimension one ideals 

In this section we find generators for the transfer of a codimension one ideal 
I' C U(q') in the stable range. First, by an explicit computation, we will exhibit 
a certain ad-invariant finite-dimensional subspace of U (q) contained in the ideal 
I = 9(1'). Then we use Theorem 12.31 to conclude that this subspace generates 
I as a (left or right) J7({j)-module. This step also applies to transfers of more 
complicated ideals of U(g'). 

4.1. General linear case. The Weyl algebra associated with the reductive dual 
pair (fll„, fllfc) may be identified with the algebra of polynomial coefficient differen- 
tial operators on n x k matrices, corresponding to the realization W = M n ^ ffi M* k 
for the symplectic vector space. Let X be the n x k matrix with entries Xi a , the 
coordinate functions on M ni fc and D be the n x k matrix with entries djb, the cor- 
responding partial derivatives. Denote the standard generators of Ql n given by the 
matrix units by , 1 < i,j < n, and arrange them into a single n x n matrix over 
U(Ql n ): 







En 


E12 


■ Ei„ 




(4.1) 


E = 


E21 


E22 


■ E 2n 


6 M n (t/( fl lJ) 






E„i 


E„2 • 


E nn 





It turns out that the image of E under the homomorphism R into W can be (almost) 
factorized as follows: R(E) = XD* + \l n - Similarly, if we denote by E' the k x k 
matrix whose entries are the standard generators of gl k then L(E') = X'D + 
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In order to simplify some of the formulas that follow, we now modify the definition 
of L and R, so that 

(4.2) i(E') = X*D, R(E) = XD*. 

These unnormalized homomorphisms L and R have almost all the properties of 
the original ones, except that the images of gl n and gl k no longer belong to W 2 , 
the symplectic subalgebra sp 2kn °f the Weyl algebra. We will, therefore, consider 
the "unnormalized transfer" based on the modified maps L and R defined by the 
formula 14.21 

Definition 4.3. Let / = (ii, . . . , ik+i), J — (ji, ■ ■ ■ ,jk+i) be two (k + l)-element 
sequences of indices from 1 to n. The quantum minor E/j is an element of U(gl n ) 
given by the following noncommutative determinants (of either row or column type): 

E/j = ^sgn(a)(E + k) la{l)31 . . . (E + l) Mfc)Jt E Mfc+1) , fe+1 

where scalars denote the corresponding scalar multiples of I n and the sum is taken 
over all permutations a 6 S^+i- 

Quantum minors of given order quantize ordinary minors ofnxn matrices and 
span an ad-invariant subspace of U(gl n ). Moreover, we have proved in [23] that 
the quantum minors of order k + 1 strictly generate the ideal ker R, called the rank 
ideal associated with the reductive dual pair (gl nl Ql k ). 

It follows immediately from the definition of transfer that the transfer of any 
ideal I' of U(g') contains keri?. Conversely, if we find a set of generators for 
L(I')W <~) R(U (q)) as an R(U (g))-module then supplanting them with the quantum 
minors of order k + 1, we obtain a set of generators of 0(1') as a J7(g)-module. 

Proposition 4.4. The second component W 2 of the Weyl algebra decomposes under 
the adjoint GLk x GL n -action as follows: 

(4.5) W 2 ~ S 2 {W) - S 2 {M n , k ) 8 (Mn )fc <g> M^ fc ) © S 2 {M* n ^ k ). 

Moreover, the middle summand is isomorphic to gl n Ofll^.. 

Proof. The first isomorphism is given by the GL(14^)-invariant unnormalized sym- 
bol map. The decomposition of S 2 (W) follows from the multiplicativity of the 
symmetric power, S(U © V) = S(U) ® S(V). The last assertion holds due to the 
canonical isomorphisms M n , k ^ K" <8 K* k , M* k ~ K*" ® K fe , gl n ~ K" ® K* n , 
g[ fe ~ K fe (g) K** 1 . □ 

Let V be the subspace of U(gl k ) spanned by the entries of the matrix E' + ii/., 
where t is a fixed scalar, /' be the ideal of U(gl k ) generated V', and let I = 6(1') be 
its transfer to U(gl n ). It is clear that V is isomorphic to gl k as an ad (gl k )- module 
and that the element tr E' + kt spans the one-dimensional ad-invariant (central) 
subspace of V . Since 

trL(E') = J2x ia d ia = tri?(E), 

ia 

we see that tr E + kt is contained in /. 
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To find further elements of the ideal /, let us use the ad(g[ fc )-invariant multipli- 
cation pairing of V with the subspace of W 2 corresponding under the symbol map 
to the middle summand in the decomposition (|4.5[) . This subspace is spanned by 
the elements {xibdj a } and we compute: 

^2 L ( E 'ab) x ibdja = ^2 XladlbXi b d.j a = ^2 x ibdibXi a d ja + (k - n)8 ab x ia d ja , 
ab ab,l ab.l 

where the summation is over a, b between 1 and k and over I between 1 and n. 
The right hand side is equal to J^i R(Eu)R(Eij) + (k — n)-R(Ey), whose preimage 
under R is the ij entry of E 2 + (k - n)E. Replacing L(E') with £(E') + tl k has the 
effect of adding tJ2 a Xi a dj a — tR(Eij) to both sides. Therefore, the subspace V of 
U(gl n ) spanned by tr E + kt and the entries of the n x n matrix E 2 + (k — n + i)E 
is contained in /. This subspace is ad(gl n )-invariant and it follows from Theorem 
12.31 that its image under R generates L(I')W (~l R(U(g)) as a {/(g)-module. We 
summarize the description of the transfer of a codimension one ideal of U(gl k ) in 
the following theorem. 

Theorem 4.6. Let (g,g') = (gl„,gtfc) with 2k < n and let I' be the annihilator of 
the one- dimensional module E' b i— > —t8 a b over gl k . Then its unnormalized transfer 
I is a quantization of the closure of the small orbit Ok of rank k in g[„. Moreover, 

(A) The ideal I has an ad-invariant system of generators spanned by 

• trE + fci, 

• the entries of p(E), where p(u) = u 2 + (k — n + t)u, 

• the quantum minors E/ j of order k + 1 . 

(B) The corresponding primitive quotient of U(gl n ) may be identified with the 
ring of differential operators on an algebraic variety in the following cases: 
for t — 0, the quotient is isomorphic to the algebra of global differential 
operators on the Grassmanian Gr(k,n); for an integer t, k < t < n — k, 
it is isomorphic to the algebra of the algebraic differential operators on the 
singular rank variety formed by the t X (n — t) matrices of rank at most k. 

Proof. Part (A) has already been established. To demonstrate Part (B), we will use 
Theorem 11.31 and Theorem 15 . 51 whose proofs in Section [5] are logically independent 
from the rest of the article. 

Consider first the case of the rank variety. Levasseur and Stafford have studied 
in |15j the annihilator J k of the unitary highest weight module arising as the unnor- 
malized theta lift of the trivial representation for the reductive dual pair (U Pjq , U k ) 
of compact type, where p,q > k + 1 and proved that the corresponding primitive 
quotient is the ring of differential operators on the singular afhne variety of p x q 
matrices of rank at most k. Let p — t, q = n — t, then the assumption on p, q holds. 
By Theorem ll.31 I C J k . However, both I and J k have the same associated variety, 
namely, the closure of the small orbit of rank k. Therefore, these ideals coincide. 

The case of the Grassmannian is analogous. Borho and Brylinski proved in [5] 
that the homomorphism from U(gl n ) into the algebra of global differential operators 
on the Grassmannian Gr(fc, n) induced by the gl n -action (|4.2| on n x k matrices is 
surjective and its kernel J quantizes the closure of the small nilpotent orbit of rank 
k. By Theorem I5.5| J contains /, therefore, these ideals coincide. □ 
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With applications to theta correspondence in mind, Section we formulate 
the description of the transfer resulting from using the normalized maps L and R 
(defined before 

Corollary 4.7. Let = (0[„,fl^) with 2k < n and let I' be the annihilator 

of the one- dimensional module E' ab \— > aS a b over gl k . Then its normalized transfer 
I C U(gl n ) has an ad-invariant generating set spanned by the following elements: 

• tr E — ka, 

• the entries of p(E), where p(u) = (u — k/2)(u — (n — k + a)/ 2), 

• the twisted quantum minors Ejj(— k/2) of order k + 1. 

4.2. Symplectic — orthogonal case. The arguments in this case are similar to 
the general linear case considered above. The role of the matrix E is played by 
a skew-symmetric matrix F whose entries are the standard generators of the Lie 
algebra Ojv in its "canonical" realization by the skew-symmetric N x N matrices. 

Let us briefly recall Howe's description of the irreducible reductive dual pairs 
of type I over an algebraically closed field. Let U be a symplectic and V be an 
orthogonal vector space over K, both finite-dimensional, then W = U ®V , endowed 
with the product of the forms on U and V, is a symplectic vector space. The 
isometry groups Sp{U) and 0(V) of the forms embed into Sp(W) and form a 
reductive dual pair in it, and their Lie algebras sp(U) and o(V) form a reductive 
dual pair of Lie algebras in sp(W / ). 

Proposition 4.8. The second component W 2 of the Weyl algebra decomposes under 
the adjoint Sp(U) x 0(V)-action as follows: 

(4.9) W 2 ~ S 2 (W) = S 2 (U) <g> S 2 (V) © A 2 (U) <g> A 2 (V). 

Moreover, S 2 (U) ~ sp(U) and A 2 (V^) ~ o(V) are the adjoint representations of 
Sp(U) and 0(V), while A 2 (U) and S 2 (V) contain one- dimensional summands cor- 
responding to the symplectic form on U and the orthogonal form on V . 

Proof. The first isomorphism is given by the 5'p(W / )-equivariant symbol map. The 
decomposition of S 2 (U ® V) as a GL(U) x GL(V) module is given by the Cauchy 
formula, with the summands corresponding to the partitions (2) and (1, 1) of 2. 
The statements concerning the adjoint representations are part of the theory of 
Cayley transform for classical groups, and the last assertion is obvious. □ 

Let (g,£)') = (c>Ar,sp 2fc ). We use an identification of the Weyl algebra with the 
polynomial coefficient differential operators on the space of N x k matrices and a 
particular realization of the reductive dual pair with the symplectic vector space 
completely polarized. Similarly to the general linear case, consider the N x k 
matrices X and D consisting of the coordinate functions and the partial derivatives. 
Let P be the N x 2k matrix obtained by putting them together, and consider its 
transpose, its conjugate with respect to the symplectic form with the matrix J, and 
the conjugate transpose, which are explicitly given in the block form as follows: 



P = [X D] , P* = 



P* = 



D* 

-X* 



P*' = f-X Dl , J = 



-I fc 
I fc 



The root generators of sp 2 k are arranged into a 2k x 2k matrix F', and the standard 
generators of On are arranged into an N x N skew-symmetric matrix F. The images 
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of F' and F under the homomorphisms L and R into the Weyl algebra are the 
following matrices of differential operators on Mjv^, cf |12j: 

N 

(4.10) L(F') = P'(P*) 4 + -I 2k , R{F) = PP* + kl N . 

Definition 4.11. Let / = i 2 , ■ ■ . , «2fc+2) be a sequence of indices from 1 to N. 
The quantum pfaffian Pfj of order k + 1 is the following element of U(on): 

P ^ = 2 k+1 (k + 1)! ^ sgn '- cr -' F ^( 1 ) i <'( 2 ) ' ' ' F M2fc+i)M2k+2) > 

where the sum is taken over the permutations a £ S 2 k+2- 

Quantum pfaffians are quantizations of the ordinary pfaffians of skew-symmetric 
N x N matrices. They are skew-symmetric in their indices and span an ad-invariant 
subspace of U(on), [121 HBJ- Combining the techniques of [23] with the identities 
proved in op cit, one can demonstrate that the rank ideal ker R is generated by the 
quantum pfaffians of order k + 1. 

Proposition 4.12. Letp(t) = t 2 — (N/2 — \)t. Then the matrix p(F) is symmetric. 

Proof. From the commutation relations between the entries of the matrix F it 
follows that 

(F%- - (F 2 )j-j =5>« F « - FtfFa = = 

i / 

= £(F y - SijFu - 5 a Fy + ^Fh) = (JV - 2)P«, 

i 

and this is equivalent to the statement we needed to prove. □ 

Theorem 4.13. Let (g,g') — (0Ar,sp 2j t) with 4k < N and let I' be the annihilator 
of the trivial representation of sp 2 k- Then its transfer I is a quantization of the 
closure of the small nilpotent orbit 2 k of rank 2k in On. Moreover, 

(A) The matrix p{F), where p(u) = (u — k){u — (N/2 — k — 1)), is symmetric, 
its entries span an ad-invariant subspace ofUipiq), and together with the 
quantum pfaffians of order k + 1, they generate the ideal I; 

(B) If N — 2n is even and 2k < n— 1 then the corresponding primitive quotient 
is isomorphic to the ring of the algebraic differential operators on the variety 
of skew- symmetric n x n matrices of rank at most 2k. 

Proof. We need to determine the result of the sp 2 fc-i n variant multiplication pairing 
of the subspace of W spanned by the entries of L(F') with the first summand in 
the decomposition (|4"3]) . First, let us transform (P*(P**)P*) ai = Eb( p * p **)a&Pi&: 

]T Pi„PJiP« = $>la, P h *;]P«, + P& Pla, P»] + Pk» P»]Plo + PftP&Pla. 

Here and below the indices a, b corresond to the symplectic vector space U and run 
from 1 to 2k, and the indices i, j, I correspond to the orthogonal vector space V and 
run from 1 to N. Substituting [Pz^P^] = ~S ab , [P/ Q ,P. i6 ] = Su3 ab and taking into 
account that ^6 Jab^ti = P »! we S et 

(P t (P* t )P t ) M = -iVPi +P ia +2fcP i0 +^(PP*)«P i0 = (-iV+2fc+l)P fa +(PP*P) io . 

I 
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Thus we have established the following convolution formula: 

(4.14) _ 

(P*(P**)P*) M = J2( pp * + (~ N + 2k + 1)Ijv)«P| - ((PP*P + (-N + 2k + 1)P) W . 

i 

Now multiply both sides by P*j and sum over a to get 

^(P t p**) a6 Pi 6 p: j = (pp*) 2 + i-N +2k+ i)pp*. 

ah 

Recalling the formulas (|4. 1 0[) for the images of F' and F in the Weyl algebra, we 
thus obtain 

(4.15) 2L(P')«6P«P^=i2(p(F)) tf , p(u) = (u-k)(u-(--k-l)). 

ab 

This completes the computation of the sp 2 fc~ mvai 'i an t multiplication pairing. The 
subspace of W spanned by the right hand side of (|4.15|) is contained in T = (/' • W) n 
R(U(g)) and generates it as a i?(?7(g))-module. Indeed, its associated graded is the 
subspace U a from Theorem 12.31 that generates grX. We conclude that the entries 
of p(F) generate / = 9(1') modulo the orthogonal rank ideal keri?. Therefore, 
the quadratic elements p(F)ij and the quantum pfaffians of order k + 1 together 
generate the ideal /. 

As in the general linear case, Part (B) follows from [15] . where the ring of dif- 
ferential operators on the singular rank variety was identified with the primitive 
quotient of U(on) by the annihilator of the theta lift of the one-dimensional repre- 
sentation of the compact form of the symplectic group. □ 

5. Relation between transfer and the Howe duality 

In the previous section we have given applications of the transfer map to explicit 
quantization of the orbits in classical Lie algebras. However, our original motivation 
for introducing this map came from the theory of reductive dual pairs and the local 
theta correspondence over K. In short, the transfer 6(1') of an ideal /' in U(q') 
provides a lower bound on the annihilator ideal / in U(g) of representations in the 
Howe duality correspondence with any representation with annihilator ideal We 
consider two algebraic versions of the Howe duality and use them to prove the lower 
bound theorem. Then we review the approach to Capelli identities based on the 
theory of reductive dual pairs, introduce noncommutative Capelli identities and 
explain how the transfer map may be viewed as a system of identities determined 
by a reductive dual pair (q,q') and an ideal /' of U(q'). (A different approach 
to noncommutative Capelli identities in the general linear case, not involving dual 
pairs, was developed in [19].) 

5.1. Proof of the lower bound on the annihilator ideal. Our proof of The- 
orem [T73] establishing a lower bound on the annihilator of a representation arising 
from Howe correspondence relies on the description of the Howe duality for admis- 
sible representations in the real case given in [9], which we now recall. Suppose 
that (Go,Gq) is a reductive dual pair of real Lie groups in the symplectic group 
Sp = Sp(Wo), where Wo is a symplectic real vector space. We denote by g and 
q' the complexified Lie algebras of Go and G , which form a reductive dual pair 
of Lie algebras. The metaplectic two-fold cover Sp of Sp acts in the space u> of 
the oscillator representation and this action induces linear representations of the 
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metaplectic two-fold covers Go and G' of the members of the dual pair. One may 
choose a maximal compact subgroup U of Sp (U is a unitary group) in such a way 
that the associated Cartan decomposition of Sp induces Cartan decompositions 
of Go and G' . Thus it makes sense to consider restrictions of a Harish-Chandra 
module of Sp to Go and G' , and likewise for the metaplectic covers. From now 
on we replace representations of groups with the corresponding (g, if)-modules of 
if -finite vectors. The complexified Weyl algebra W is identified with the algebra of 
the endomorphisms of to whose Sp-conjugates span a finite-dimensional subspace 
of End uj. 

Definition 5.1. Irreducible admissible representations p and p' of Go and G' Q 

correspond to each other under the Howe duality if there exists an Ad(Go • G' Q )- 
invariant subspace ujq of to such that the quotient module lo/ujq is isomorphic to 
p®p'. 

The main theorem of [9] asserts that this correspondence is a partial bijection 
between the sets of equivalence classes of irreducible admissible representations of 
the metaplectic covers of the members of the reductive dual pair. "Forgetting" 
about the actions of the maximal compact subgroups on p and p', we can formulate 
an entirely algebraic version of Howe duality for representations. 

Definition 5.2. Let (g, g') is a reductive dual pair of Lie algebras and A be a fixed 
non-zero module over the corresponding Weyl algebra W. Then a g-module V and 
a g'-module V are in the algebraic Howe duality with each other if there exists 
an Ad(G)-invariant and Ad(G')-invariant subspace Ao of A such that the quotient 
A/Ao is isomorphic to V <8> V as a g-module and a g'-module. 

Remark 5.3. The annihilator ideals of the modules V and V in U(g) and U(g') 
can be detected from the quotient A/ Aq. They are the annihilators of this quotient 
viewed as a L T (g)-module and as a t/(g')-module. 

The transfer map 9 comprises of two steps. The first step takes the ideal I' of 
U(q') into the Ad(G • G')-invariant right ideal X = L(I') ■ W of W, and the second 
step replaces X with its pullback to U(q), R~ 1 (X) = 0(1'). This observation forms 
a basis for our final algebraic approximation to Howe duality. 

Definition 5.4. Let (g, g') be a reductive dual pair of Lie algebras. Then two-sided 
ideals I C U(g) and I' C U (g') are in the algebraic Howe duality if there exists an 
Ad(G) and Ad(G')-invariant right ideal X of the Weyl algebra such that / and I' 
are its pullbacks with respect to the maps R and L into W. 

It is clear that if ideals I' and I are in algebraic duality then 0(1') C 7, for 

O(I') = R- X (L(I')W) C R-\X) = I. 

Moreover, if two admissible representations of the metaplectic covers of Go and G' 
correspond to each other under the ordinary Howe duality then their underlying 
g-module and g'-module are in the algebraic Howe duality in the sense of Definition 
15.21 Therefore, Theorem If .31 follows from the following more general statement. 

Theorem 5.5. Let V and V be two modules in the algebraic Howe duality in 
the sense of Definition \ 5.2[ Denote the annihilator of V in U (g) by I and the 
annihilator ofV in U(q') by I'. Then the ideals I and I' are in the algebraic Howe 
duality. 
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Proof. Let X be the annihilator in W of Aj Aq. Then X is an Ad(G)-invariant and 
Ad (G') -invariant right ideal of the Weyl algebra whose pullbacks to U (g') and U(q) 
via the maps L and R are precisely /' and /, establishing the claim. □ 

There is a weak converse to Theorem 15.51 c/Remark 15.31 

Theorem 5.6. Let I and I 1 be two ideals in the algebraic Howe duality in the sense 
of Definition \57^\ Then there exists a W-module A and an Ad(G) -invariant and 
Ad(G') -invariant subspace Aq, such that A/ Aq has annihilator I as a U(g)-module 
and annihilator I' as a U(q') -module. 

Proof. Suppose that X be the right ideal of W realizing the algebraic Howe duality 
between I and Let A = W and .Ao = 2"- Then the conditions that / = R^ 1 (X) 
and /' = L^ 1 (X) translate into the conditions that the annihilators of A/Ao as a 
[/(g)-module and as a [/(g')-module are / and □ 

5.2. Noncommutative Capelli identities. The complex general linear groups 
GLk and GL n act on the vector space Mfc jW of complex kxn matrices by matrix left 
and right multiplication. Thus one obtains a pair of commuting actions of their Lie 
algebras by polynomial coefficient differential operators. The generators of gl fc and 
g[„ act on polynomials via polarization operators of the classical invariant theory. 
Capelli's remarkable accomplishment was to prove the full isotypic decomposition 
of the space of polynomial functions on Mfe >n under the pair of commuting actions 
of GLk and GL n , using the Capelli identity as a tool. This G or dan- Capelli de- 
composition also known as the (GL n , GLfc)-duality, is multiplicity-free, and the 
representations of the two groups that occur in it determine each other. In [llj . 
Howe and Umeda elucidated the role of the Capelli identity in the proof. The 
two general linear Lie algebras involved form a reductive dual pair (g[„,glfc) and 
this leads to a relation between the centers of their universal enveloping algebras. 
Specifically, let us assume that k <n, then the Capelli identity provides an isomor- 
phism between Z(gl k ) and a certain subalgebra/quotient of .Z(g[ n ), both of which 
are polynomial algebras with k explicitly given generators. This isomorphism arises 
from the identity 

(5.7) R(Ci) = L(Cl) 

in the algebra of polynomial coefficient differential operators on Mfc )TJ and is deter- 
mined by the formula C[ ^ G; for 1 < i < k. Here C[ and Ci are the ith (central) 
Capelli elements of degree i in U($l k ) and U(gl n ), 1 < i < n, and G- = for 
i > k + 1. Setting Gj = for i > k + 1 exhibits the algebra K[Gi, . . . , G/.] as a 
quotient of Z(g[„). By the theory of highest weight, finite-dimensional simple gl„- 
modulcs and g[ fc -modules are uniquely determined by their infinitesimal character, 
therefore, the Capelli identity (|5.7[) determines the matching of gl n -modules and 
g[ fc -modules in the Gordan-Capelli decomposition. 

The actions of the groups GL n and GL k by matrix multiplications are complex- 
ifications of the actions of their maximal compact subgroups, the compact unitary 
groups U n and Uk forming a reductive dual pair (U n ,Uk) in the real symplectic 
group 5p2nfc(R)- Up to twists by certain powers of the determinant characters, 
these latter actions arise by restricting the oscillator representation of the symplec- 
tic group, realized in the Fock model, to the members of the compact dual pair. 
(The twists are reflected in the difference between the normalized and unnormalized 
versions of the maps L and R.) In this setting, the Capelli identity (|5.7p between 

14 



the images of the algebra generators of the centers of U(g) and U(g') completely 
describes the matching of representations under the Howe duality. Now, let us 
consider a reductive dual pair (U Ptqi U riS ) of definite or indefinite unitary groups in 
Sp2(p+q)(r+s)(^)i an( i assume that at least one of the groups is non-compact. The 
classical Capelli identity leads to a correspondence of the infinitesimal characters 
for those representations p and p' of the metaplectic covers of Go and G' which 
correspond to each other under the Howe duality. However, there is a fundamen- 
tal difference between representation theory of compact and noncompact reductive 
groups: in the noncompact case, irreducible admissible representations are not de- 
termined by the infinitesimal character alone. Thus in this case the Capelli identity 
yields only partial information on the Howe duality correspondence. Capelli iden- 
tities for other reductive dual pairs, which were established by Molev-Nazarov and 
Itoh, [T2J[TS], involve only the central elements, consequently, they suffer from the 
same defect. 

The transfer map I' i— > 8(1') serves to sharpen the description of the Howe 
duality, by incorporating more refined information on the representations p and p', 
namely, their annihilator (primitive) ideals. 

Definition 5.8. Given a family of representations of g, a noncommutative Capelli 
identity is an element of the universal enveloping algebra U(q) which acts by 
on any representation p from this family. An identity is central if the element 
belongs to Z(q). A set of noncommutative Capelli identities is called a system of 
noncommutative Capelli identities if it spans an ad-invariant subspace of U(q). 

Noncommutative Capelli identities form an ideal in U(gl n ) and that a (minimal) 
ad-invariant generating subspace produces a (minimal) system of identities, with 
others being their formal consequences. Next we present some examples. 

(1) The theory of rank for ideals of U(gl n ), [23], gave the first examples of 
systems of noncommutative Capelli identities that are not central. In this 
special case, I' is the zero ideal, 9(1') = keri? is the A;th rank ideal of U(g[ n ) 
and is generated by the (normalized) quantum minors of order k + 1. The 
corresponding identities are satisfied in any representation of the metaplec- 
tic cover of U p . q which appears in the Howe duality with a representation 
of the metaplectic cover of U rjS , where p + q = n, r + s = k. 

(2) More generally, Theorem 11.31 provides a system 8(1') of noncommutative 
Capelli identities for representations of g that occur in the Howe duality 
correspondence with a representation of q' whose annihilator /' has been 
fixed. 

(3) As a specialization, Corollary 14.71 (in the general linear case) and The- 
orem 14.131 (in the symplectic-orthogonal case) described an ad-invariant 
generating space for the transfer of a codimension one ideal. It follows 
from Theorem 1 1 . 31 that we have thus obtained a system of noncommutative 
Capelli identities satisfied on the theta lifts of one-dimensional representa- 
tions. The degree 2 elements are new. 

(4) Further examples are obtained from the theory of minimal polynomials and 
quantized elementary divisors for jj-modules, [20l[2Tj . 
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6. Complements and open questions 

6.1. Skew analogue. The theory developed in this paper has a natural "skew" 
analogue for reductive dual pairs in an orthogonal Lie algebra, with Clifford algebra 
in place of Weyl algebra, cf [H [10l [12] . Since unlike the oscillator representation, the 
spin representation is finite-dimensional and decomposes into a direct sum of the 
tensor products of simple modules for G and G' , in effect one is dealing with finite- 
dimensional modules and their annihilators, which completely determine each other 
when G and G' are connected (i.e. excluding the orthogonal - orthogonal case). 
This results in a streamlined behavior of the transfer map, which becomes a bijec- 
tion between finite sets consisting of the annihilators of certain finite-dimensional 
simple modules for G and G' . On the other hand, in the skew-symmetric case the 
moment maps and quantization are no longer relevant to the story. 

6.2. Effect on primitive ideals. From our algebraic perspective, the most inter- 
esting question about transfer concerns the behavior of primitive and completely 
prime ideals. 

Question 6.1. Let (fl, fl') be an irreducible reductive dual pair of Lie algebras in 
the stable range with the smaller member g' . Suppose that I' is a primitive ideal 
of U(g'). Is it true that its transfer 6(1') is a primitive ideal of U(g)7 The same 
question replacing "primitive" with "completely prime" . 

More generally, suppose that (g,g') is a reductive dual pair with g' the smaller 
member, then one might ask the same questions for sufficiently small ideals /' of 
U(g'). The precise condition is that the associated variety of I' has nonempty 
intersection with a Zariski open subset of g' over which the moment map I is 
cquidimcnsional with irreducible fibers. For the general linear case this amounts 
to the restriction that the corresponding nilpotent orbit contains a matrix whose 
rank is at least 2k — n. Partial progress towards answering these questions has been 
made in [201121]. 

In the general linear case, the set of primitive ideals admits a combinatorial 
parametrization in terms of Young tableaux that is essentially due to Joseph. In 
[22], I used it to construct a bijection between the set of primitive ideals of U(gl k ) 
and the set of primitive ideals of U(gl n ) that have pure rank k. I think that 
this combinatorially defined bijection describes transfer for the reductive dual pair 
(gl n ,glk) with n > 2k at the level of Young tableaux, but I have not been able to 
prove it. 

6.3. Is the transfer bound exact? Let (Go, G' Q ) be a reductive dual pair of real 
groups in stable range, with G' the smaller member, and suppose that irreducible 
admissible representations p and p' of their metaplectic covers are in Howe duality. 
It is natural to conjecture that if the representation p' is unitary then d(Ajmp') = 
Ann p, in other words, that the transfer bound is sharp. (I had first learned a more 
qualitative form of this conjecture from P. Trapa.) J.-S. Li's description of singular 
unitary representations and T. Przebinda's results on the behavior of the wave front 
sets under the Howe duality, [TH [24] , constitute strong supporting evidence for the 
conjecture. In particular, in the stable range, the annihilator of the theta-lift of a 
one-dimensional representation of the smaller group is generated by the elements 
from Corollary 14.71 and Theorem 14.131 Nonetheless, explicit computations of the 

16 



Howe duality correspondence indicate that neither the stable range condition nor 
the unitarity of p' could be completely eliminated from the assumptions. 
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